Superfuid-insulator transitions at non-integer filling in optical lattices of fermionic atoms 
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We determine the superfluid transition temperatures Tc and the ground states of the attractive Hubbard model 
and find new insulating phases associated with non-integer filling at sufficiently strong pairing attraction \U\. 
These states, distinct from band and Mott insulating phases, derive from pair localization; pair hopping at 
large \U\ and high densities is impeded by inter-site, inter-pair repulsive interactions. The best way to detect 
the breakdown of superfluidity is using fermionic optical lattices which should reveal new forms of "bosonic" 
order, reflecting ground state pairing without condensation. 
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The attractive Hubbard Model has captured the attention 
Jit] of the theoretical and experimental communities, although 
this model is far from fully understood. It is hoped that ex- 
periments using ultracold fermionic atoms in optical lattices 
13] will shed light both on competing ground states and on 
finite temperature T effects, and moreover, provide insights 
into high temperature superconductivity, largely through the 
very ubiquitous "pseudogap" effects. These derive from [3] 
the fact that as the attraction becomes stronger, pairing takes 
place at a different temperature, T* from superfluid conden- 
sation, Tc- 

For bosonic systems at half filling the strong (repulsive) 
interaction limit gives rise to superfluid-Mott insulator tran- 
sitions It is a central goal of this paper to investi- 
gate this counterpart strong (attractive) interaction regime for 
fermions and demonstrate that superfluid-insulator (SI) transi- 
tions (away from integer filling) are also present. Indeed, the 
latest experiments on fermions] 2] reveal competing insulating 
and superfluid ground states. It is not yet clear whether these 
insulating phases are band insulators or localization-induced 
insulating phases. We note that the largest coupling regime we 
address in this paper has not yet studied by Monte Carlo ^ 
or other methods ]6], despite the fact that a comparably strong 
(dimensionless) interaction strength is required for bosonic 
systems to undergo SI transitions. 

Our finite T approach to the Hubbard model includes pair 
fluctuations in a manner which is consistent with the stan- 
dard BCS-Leggett ground state and, most importantly, with 
a proper and physical treatment of pseudogap effects. We 
stress, however, that these non-condensed pair effects must 
necessarily be treated differently from previous Nozieres- 
Schmitt-Rink JiTJ based approaches to T ^ 0. Indeed, fol- 
lowing Ref. ]|7t], essentially all other pairing fluctuation ap- 
proaches to BCS-BEC crossover contain an inherent inconsis- 
tency; th ey presume th at in the fermionic dispersion relation 
i?k = v^Ck + ^"^{T), the so-called pairing gap A vanishes 
at and above Tc- These non-condensed pairs (present for all 
< r < T*) are also essential for arriving at physical values 
for the transition temperature Tc. Without including them it is 
not possible to know about ground states with Tc = 0, which 
will naturally occur, e.g., in the present theory ]8] in two- 
dimensional lattices, as compatible with the Mermin- Wagner 
theorem (in the absence of Kosterlitz-Thouless or other topo- 



logical order). This underlines the fact that one cannot solve 
the BCS-Leggett T ~ equations in isolation to characterize 
the stable ground states. 

Our principal result is that, in addition to the expected 
band insulating state (at filling n = 2), a new insulating 
phase, which is stabilized by pair fluctuations, emerges when 
n and the interaction strength exceed appropriate critical val- 
ues. Strikingly, the critical value for the dimensionless inter- 
action strength is comparable to that found for the Bose Hub- 
bard model ]4]. This new insulating phase is different from 
the Mott or band insulator, both of which occur only at inte- 
ger filling, but like the Mott case it is due to localization (of 
fermion pairs). To address cold atom optical lattices, we also 
extend the attractive Hubbard model to a two-channel model 
and find that the insulating phases at non-integer filling sur- 
vive; thus, pair localization is a robust effect. 

Our work can be contrasted with previous studies, which 
focused only on T = ]l9l [T^, [H [11 and with Monte Carlo 
(MC) JH] as well as dynamical mean field theoretic approaches 
Jg]. In the moderate coupling regime, where comparisons can 
be made, we find transition temperatures to be of compara- 
ble order of magnitude, albeit slightly larger (factors of 2). In 
part this derives from the fact that the standard BCS-Leggett 
ground state considered here does not include ]6] the Gorkov- 
Melik-Barkhudarov ifisll effect. This semi-quantitative differ- 
ence should not be of concern because different MC calcula- 
tions ] 14, _15J of Tc in a unitary Fermi gas have not yet con- 
verged to better than factors of L5. 

Of particular interest here are the properties of the attractive 
Hubbard model, in the limit that the attraction |?7| is much 
larger than the hopping t. While this model exhibits a smooth 
crossover from BCS to Bose-Einstein condensation (BEC) 
with increasing \U\, it should be stressed that the BEC here 
is very different from that of true bosons, since the hopping of 
the pairs involves, as an intermediate or virtual step, their un- 
binding into fermions. In this way the inverse pair mass was 
argued l?, 7] to vary as t^/|C/|. Important for the present pur- 
poses is the fact that there is also a nearest neighbor repulsion 
li^\3]vhich is of the same magnitude as the effective pair hop- 
ping term. On this basis it has been argued that fl}] "at higher 
densities the overlap of the bound pairs severely restricts their 
motion". This quotation is particularly relevant to our find- 
ings; we show that at sufficiently high n the pair motion is 
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so restricted that their effective mass diverges prematurely be- 
fore \U\ oo. This locaHzation, in turn, is associated with 
the breakdown of superfluidity. 

This frustration of superfluidity at high n can also be ad- 
dressed via a mapping to a magnetic model. When \ U\/t ^ 1 
the attractive Hubbard model is equivalent to [ 1 ] an effective 
quantum XXZ model with coupling constants Jxx ~ —Jz, 
both of which are proportional to t'^/\U\. This mapped prob- 
lem is subject to the constraint that the average magnetization 
along the z-axis is fixed at [n — l)/2, making this a rather dif- 
ficult magnetic model to solve in general. Superfluidity corre- 
sponds to ordering in the x — y plane. When n is small, the 
constraint is straightforward to implement and superfluidity 
emerges. However, at high densities (n « 1) new states with 
order along the z-axis are expected [ 1 ] to emerge, thereby, de- 
stroying the superfluid phases. Indeed, it is well known that 
for n strictly equal to 1 , the simple superfluid ground state is 
undermined as a result of a degeneracy with a charge ordered 
ground state 1 1 ] . 

We now address these effects by investigating the physics 
of fermions which interact via s-wave attraction in a three di- 
mensional (3D) square lattice, we start with the one-channel 
attractive Hubbard model Hamiltonian 

+ ^ H 4+q/2T^-k+q/2iC-k'+q/2iCk'+q/2T-(l) 
kk'q 

Here Ck = fk ^ A*, where /i is the chemical potential. The one- 
particle energy dispersion is ek = 2t[3 — cosfcx — cos ky — 
cos kz] in a one-band nearest-neighbor tight-binding approx- 
imation, where the values of k are restricted in the first Bril- 
louin zone, and we set lattice constant aq = 1. U represents 
the attractive on-site coupling. "Resonant" scattering, which 
corresponds to an infinite two body scattering length, occurs 
at U/t w -7.915, in agreement with Ref. 116J. Note that 
by adopting the Hubbard model we drop any terms associated 
with direct pair hopping which should not be important in the 
regime we focus on here where /i is positive or only slightly 
negative. We consider a one band model, on the premise that 
multi-band effects will change the results quantitatively but 
not qualitatively. There is still uncertainty in the literature lfl2ll 
about whether or not an effective one band |9] model is ade- 
quate. 

We use a T-matrix formalism to address finite 

temperature. This particular T-matrix approach has a crucial 
advantage because it leads to physical results for the super- 
fluid density ns{T). This single valued, monotonic and con- 
tinuous behavior (from zero to Tc) for Ug (T) is not found in 
other theories; this physical behavior can be traced to a self 
consistent treatment of pseudogap effects H], in which pair 
fluctuations enter into both the gap and the number equations 
in a fully self-consistent fashion 

Details of this formalism can be found in [3]. We define the 
noncondensed pair propagator as tpg{Q) — U/[l + Ux{Q)], 
where, as in Ref. 119D, our choice for the pair susceptibility, 
given by xiQ) — J2k^o{Q — K)G{K), can be derived 
from decoupling the Green's function equations of motion. 



Here G{K) and Gq{K) = iujn — are the full and bare 
Green's functions. K = {iojn, k) and Q = {iil„i,q) are four- 
vectors with J2k = Sk- Below Tc, the self-energy 
T,{K) = '^Qt{Q)G{){Q — K) can be well approximated 
by the BCS form, E(i^) = -A^Go{-K), where t{Q) = 
— (A^^/r)(5(Q) + tpg{Q), and Age is the superfluid order pa- 
rameter. In the superfluid state, the "gap equation" is given by 
the pairing instability condition tpg{Q) ~ U^^ + x(0) = 0, 
which is equivalent to the BEC condition on the pairs. There- 
fore, we have 



u ^ 
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Here f[x) is the Fermi distribution function. Similarly, 
the average [20] density n in a lattice, derived from n = 
Y.K,^ GaiK), is given by 



(3) 



We next determine the dispersion relation and the number 
density for noncondensed pairs. From the self-energy expres- 
sion one obtains = AL + A^^ where the pseudogap con- 



tribution satisfies 
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which can be shown to vanish at T = 0. The critical tempera- 
ture Tc is defined as the lowest temperature where Age = 0. In 
the superfluid phase (pair chemical potential /ipair = 0), and 
atsmafl Q, ^/W) = x(Q) " x(0) « ^i^^' + l^ol^^ - ^V- 
Except when particle-hole symmetry is present, e.g., at very 
weak coupling and near half filling, we find Zi <C |Zo |, which 
thus is irrelevant. Near n = 1, the Ziil^ term enters and reg- 
ularizes the van Hove singularity. To first order in 57 one can 
write Apg = |.^o|^^ Sq^(^q)' where b{x) is the Bose dis- 
tribution function. At sufficiently low q, we can approximate 
the dispersion of the noncondensed pairs by fig = q^/2M*, 
where A/* is the effective mass of pairs at the bottom of the 
band. 

In Fig. [T] we show Tc/Ep as a function of U/t for sev- 
eral values of n in the one-channel model. Here Ep is the 
Fermi energy of a non-interacting Fermi gas with the same 
filling factor As in MC simulations, Tc exhibits a maximum 
near resonance and decreases slightly when U /t is away from 
resonance. When n is small, we find a long tail in Tc propor- 
tional to t'^/\U\, as expected Importantly, it is observed 
that when n > ric ~ 0.53, Tc vanishes provided U/t exceeds 
a critical value {U/t)c- It should be noted that at the insulat- 
ing onset point, we find /i is zero or slightly positive, far from 
the true bosonic regime. The inclusion of pair fluctuation ef- 
fects is essential here for establishing Tc = beyond {U/t)c- 
This result can be contrasted with the predicted ground state 
of strict mean-field theory shown in the inset of Fig[Tl where 
A/t vanishes only at n = and n = 2 (band insulator). 

In Fig. |2]we show typical phase diagrams at low and high 
densities. In contrast to Tc, the pairing onset temperature T* 
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Figure 1: Tc/Ef as a function of U /t. The corresponding value of 
n is marked next to eacli curve. Tlie vertical dashed line indicates the 
unitary limit. Inset: T = mean-field results for A/f as a function 
of n. 




U/t U/t 



Figure 2: Phase diagrams of one-channel attractive Hubbard model 
at (a) n = 0.3 and (b) n = 0.7. 'SF' denotes superfluid, 'PG' 
denotes pseudogap phase and 'Insulator' in (b) schematically indi- 
cates breakdown of ground state superfluidity. Inset: T = phase 
diagram. Here the boundary separating BCS and BEC regimes is de- 
termined when /i reaches the bottom of the band. The gray shaded 
area shows where superfluid does not exist, corresponding to the 'In- 
sulator' regime. 



(as estimated from the strict mean-field solution for Tc), in- 
creases monotonically with \U\/t. The high density phase di- 
agram, in particular, bears some similarity to its counterpart 
in high temperature superconductors |3]. In both figures, as in 
high Tc superconductors, we see an anti-correlation between 
the behavior of Tc and T* , associated with lattice 1 1] as well 
as pseudgogap effects [8]. The complete suppression of su- 
perfluidity in Fig.|2tb) can be shown explicitly to come from 
localization of pairs; that is, the effective pair mass M* — + oo. 

In the inset of Fig.|2]we show the T = phase diagram, 
in which "BCS" ("BEC") denote states with fx higher (lower) 
than the bottom of the band. The shaded regime corresponds 
to where there is a non-superfluid ground state. The lowest 
value of {\U\/t)c ~ 25 occurs at n = 0.53. This is com- 
parable in magnitude to the critical value \U\/t « 35 of the 
Mott-superfluid transition of the 3D boson (repulsive) Hub- 
bard model with filling factor 1 [4;], although the physical ori- 
gin of the two insulators is different. 



In actual experiments, attractive interactions between the 
atoms are generated by Feshbach resonance effects, which 
in principle, require a two-channel description. Previous 
work on the two-channel model in a lattice concentrated 
on the superfluid-Mott transition in the strongly-interacting 
regime near n = 2 ifTol [Till . Other recent work dis- 
cussed band insulators in the weakly-interacting regime lfl2ll . 
The generalization of our T-matrix formalism to the two- 
channel model for Fermi gases was presented in ifisll . To 
take into account the closed-channel molecules, the Hamil- 
tonian is extended to iJ = Hf + Hi, + Hft,, where 
Ht = — ^q^qbq dcscrlbes the hopping of molecules 
and Hfb = Eq,k 5(&ijCq/2_kiCq/2+kT + h.c.) describes con- 
version between molecules and fermion pairs. Here i?™ — 
— 2n-\-v,v is the magnetic detuning, and g is the coupling 
constant for molecule-pair conversion. The strength of the at- 
tractive pairing interaction is modified relative to the one band 
case UJ] to 

C/e//(Q)-?7 + .g2Do(Q) (5) 

where Do{Q) = l/{iiln — i?™) is the propagator for non- 
interacting closed channel molecules. The gap equation in- 
volves only Ueff = UeffiQ = 0). The density in the lattice 
now becomes n = Uf + 2ni, + 2n" where the open-channel 
contribution nj is given by Eq. ([3]) and the closed-channel 
contribution comes from the molecular condensate (27t,°), and 
non-condensed molecules (2nb). The energy dispersion of 
molecules has a Bloch-like dispersion, just as found for the 
fermions. In the long wavelength limit, we may expand this 
Bloch band dispersion as e™ w /2Mb, where Mb = 2/t 
is the effective bare mass of the molecules. The fermion pairs 
have a similar dispersion and, in general, hybridize strongly 
with these closed-channel molecules. 

In our Hamiltonian we have dropped a direct closed- 
channel boson-boson repulsion. This was included in previous 
work ifTol [Till which aimed to create Mott insulating phases 
associated with the closed channel. At n = 2, because the 
closed channel represents a band which is never completely 
filled (due to the presence of the open channel), we find that 
localized states in the strict Mott sense are not obtainable as is 
consistent with Ref . fTT] . In this way we argue that it is appro- 
priate here to drop the intra-closed-channel interactions. We 
note parenthetically that to obtain a Mott insulating state one 
possibility is to treat the closed channel as composite fermion 
pairs (or hard-core bosons |1]) and to consider filling above 
n = 2. 

Figure [3] shows Tc/Ep in the two-channel model as a func- 
tion of Ueff/t for [(a) and (c)] narrow and (b) broad Fes- 
hbach resonances. Here Ueff is tuned via with fixed U 
and g in (a) and (b) and via U with fixed v and g in (c). 
Figure [3a) corresponds to the case in which there is a con- 
siderable admixture of both closed and open channels. We 
take U/t — —6 and consider a relatively naiTow resonance, 
g/t — —60, as well as two values of n = 0.7 and n = 2. For 
n = 0.7, Tc is first suppressed by the opening of the pseudo- 
gap as —Ueff increases; then Tc eventually increases with in- 
creasing — Ueff as fermions are converted into closed-channel 
molecules which have a finite BEC transition temperature. For 
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Figure 3: T^/Ef as a function of pairing interaction Ueff/t in the 
two-channel model, as tuned by (a,b) detuning f and (c) U for rel- 
atively (a,c) narrow and (b) broad Feshbach resonances. There pa- 
rameters are: (a) g/t — —60, U/t — —6, n — 0.7 (black) and 2 
(red curve); (b) n = 0.7, g/t = -600, U/t = -6; (c) n = 0.7, 
g/t — —60, i^/t = 500. The shaded regimes in (b) and (c) schemat- 
ically indicate the new, non-integer-filling insulating states. 

n = 2, the cusp in the curve comes from the van Hove sin- 
gularity at n/ = 1. For a large range of Ueff, Tc for n = 2 is 
effectively zero [21], until a sufficient number of open channel 
pairs are converted to closed-channel molecules. Importantly, 
for this case, the insulating state thereby observed is a band 
insulator. 

When we decrease the participation of closed channel 
molecules by either increasing —U/tox\g\/t, insulating states 
(of the new form, at non-integer filling) start to emerge. In 
Fig. |3lb) we demonstrate these insulating states by plotting 
Tc/Ef for n = 0.7 at U/t = -6 and a large \g\/t = 600 
(wide resonance) as a function of Ue/f/t by tuning u. In 
Fig- Etc) we plot the counterpart curve for a narrower res- 
onance {g/t — —60) as a function of Ueff/t by tuning U 
at fixed high detuning i'. In contrast to the result shown 
in Fig. [3ja)> by decreasing the fraction of closed channel 
states, as in panels (b) and (c), we find localized insulating 
phases. This localization can be demonstrated by a divergence 



in the effective pair mass. In summary, insulating states at 
non-integer filling are robust even in the presence of closed- 
channel molecules. 

The experimental implications of our work are readily 
testable, since, fortunately, using Feshbach resonances, cur- 
rent cold atom experiments |2] are able to simulate these at- 
tractive Hubbard Hamiltonians. Our principal result is the the- 
oretical observation of superfluid-insulator transitions in the 
ground state of the attractive Hubbard model away from inte- 
ger filling. To observe these new phases experimentally one 
needs to consider average densities n « 1 and sufficiently 
large \U\/t of the order of, or larger than, that required for 
superfluid-Mott insulator transitions in Bose gases |4]. Be- 
cause experimentally there is an additional background har- 
monic trapping potential, n can never be precisely specified 
throughout the lattice |20] and thus it should be possible to 
find extended regions with non-integer filling factors. The 
tunable parameters in optical lattice experiments are scatter- 
ing length and lattice potential depth Vq. While it is relatively 
easy to express t in terms of Vq, the conversion of the on-site 
attraction U in terms of the scattering length and Vq near uni- 
tarity is not as straightforward as that in free space |4i] . 

It is clear that the crucial test of the new phase diagram in 
Fig- Etb) does not lie in distinguishing whether Tc is small 
or strictly zero. Rather with Tc — Q one can invoke entropic 
considerations and deduce that signatures of this new ground 
state will involve detecting some new form of (bosonic) order. 
This may be the analogue of a (pair density wave) phase which 
appears to be present in high temperature superconductors, in 
the underdoped side of the phase diagram 12211 . 
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